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Abstract 

Background: Pediatric self-report should be considered the standard for measuring patient reported outcomes 
(PRO) among children. However, circumstances exist when the child is too young, cognitively impaired, or too ill to 
complete a PRO instrument and a proxy-report is needed. This paper describes the development process including 
the proxy cognitive interviews and large-field-test survey methods and sample characteristics employed to produce 
item parameters for the Patient Reported Outcomes Measurement Information System (PROMIS) pediatric proxy- 
report item banks. 

Methods: The PROMIS pediatric self-report items were converted into proxy-report items before undergoing 
cognitive interviews. These items covered six domains (physical function, emotional distress, social peer 
relationships, fatigue, pain interference, and asthma impact). Caregivers (n = 25) of children ages of 5 and 17 years 
provided qualitative feedback on proxy-report items to assess any major issues with these items. From May 2008 to 
March 2009, the large-scale survey enrolled children ages 8-17 years to complete the self-report version and 
caregivers to complete the proxy-report version of the survey (n = 1548 dyads). Caregivers of children ages 5 to 7 
years completed the proxy report survey (n = 432). In addition, caregivers completed other proxy instruments, 
PedsQL™ 4.0 Generic Core Scales Parent Proxy-Report version, PedsQL™ Asthma Module Parent Proxy-Report 
version, and KIDSCREEN Parent-Proxy-52. 

Results: Item content was well understood by proxies and did not require item revisions but some proxies clearly 
noted that determining an answer on behalf of their child was difficult for some items. Dyads and caregivers of 
children ages 5-17 years old were enrolled in the large-scale testing. The majority were female (85%), married 
(70%), Caucasian (64%) and had at least a high school education (94%). Approximately 50% had children with a 
chronic health condition, primarily asthma, which was diagnosed or treated within 6 months prior to the 
interview. The PROMIS proxy sample scored similar or better on the other proxy instruments compared to 
normative samples. 

Conclusions: The initial calibration data was provided by a diverse set of caregivers of children with a variety of 
common chronic illnesses and racial/ethnic backgrounds. The PROMIS pediatric proxy-report item banks include 
physical function (mobility n = 23; upper extremity n = 29), emotional distress (anxiety n = 15; depressive 
symptoms n = 14; anger n = 5), social peer relationships (n = 15), fatigue (n = 34), pain interference (n = 13), and 
asthma impact (n = 17). 
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Background 

The Patient Reported Outcomes Measurement Informa- 
tion System (PROMIS) project, a National Institutes of 
Health initiative, was developed to advance the science 
and application of patient-reported outcomes (PRO) [1]. 
One main goal of the PROMIS initiative was to develop 
a set of item banks and computerized adaptive tests for 
the clinical research community. The PROMIS pediatric 
project focused on the development of self-report PRO 
item banks across several health domains for youth ages 
8-17 years. The primary focus was on the measurement 
of generic health domains that are important across a 
variety of health states (including physical function, pain 
interference, fatigue, emotional distress, and social peer 
relationships) [2-8]. Additionally, one disease specific 
item bank was developed for children with asthma to 
explore the relationships between general and disease 
specific measures [9]. 

It is well documented in both the adult and pediatric 
literature that information provided by proxy respon- 
dents is not equivalent to that reported by the patient 
[10-14]. Imperfect agreement between self-report and 
proxy- report, termed cross-informant variance [15], has 
been consistently documented in the health related 
quality of life (HRQOL) measurement of children with 
chronic health conditions and healthy children [12,16]. 
Consistencies between child and parent proxy-reports as 
measured by intra-class correlation coefficients have 
been reported as low as 0.02 to 0.23 [13]. However, 
even as pediatric patient self-report is advocated, there 
remains a role for parent proxy-report in pediatric clini- 
cal trials and health services research. 

Although pediatric patient self-report should be con- 
sidered the standard for measuring PROs, there are 
often circumstances when the child is too young, cogni- 
tively impaired, too ill, or fatigued to complete a PRO 
instrument and a parent proxy-report may be needed 
[17]. Further, it is typically parents' perceptions of their 
child's symptoms and outcomes that influence health- 
care utilization [17-19]. Optimally, PRO instruments 
should be selected that measure the perspectives of both 
the child and the parent since these perspectives may be 
independently related to healthcare utilization, risk fac- 
tors, and quality of care [20]. Hence, the PROMIS 
pediatric project undertook the development of proxy 
item banks across several health domains (physical func- 
tion, pain interference, fatigue, emotional distress, social 
peer relationships and asthma impact) for youth ages 5- 
17 years. 

This process of developing item banks for PROMIS 
included literature review, qualitative research including 
individual cognitive interviews and field-testing 
[2,4,21-23]. This paper describes the development 



process employed for the PROMIS Pediatric Parent 
Proxy item banks. Specifically, the proxy cognitive inter- 
view process and results as well as the methods utilized 
and the final sample characteristics of the large-scale 
field-test survey designed to produce item parameters 
are reported. Other manuscripts will describe in detail 
the psychometric properties of the proxy item banks 
administered during large-scale field-testing [24]. 

Methods 

Proxy item bank development 

PROMIS domain definitions were previously published 
[4] and cover six domains (physical function which 
includes mobility and upper extremity, emotional dis- 
tress which comprises of anger, anxiety and depressive 
symptoms, peer relationships, fatigue, pain interference, 
and asthma impact). The proxy-report items were devel- 
oped from the existing PROMIS pediatric self-report 
content domains [3-7,9] and aimed to include proxy 
respondents with children ages 5-17 years of age. The 
items were revised to retain their meaning, while modi- 
fying the phrasing so that all items involved parents/ 
caregivers reporting on their 5-17 year old children. For 
example, in the PROMIS pediatric self-report pain inter- 
ference instrument [5], children responded to the item 
"I had trouble sleeping when I had pain," while care- 
givers responded to the proxy-report equivalent of this 
item, "My child had trouble sleeping when he/she had 
pain." 

All items had a 7-day recall period and used standar- 
dized 5-point response options (e.g., never, almost never, 
sometimes, often, almost always; or, with no trouble, 
with a little trouble, with some trouble, with a lot of 
trouble, not able to do) or a numeric rating from 0- 10. 
The pediatric self-report items were the basis for the 
proxy-report items as they were developed utilizing a 
process that reflected the language and context impor- 
tant to children [4]. All of the pediatric self-report 
items were converted into proxy-report items and new 
items were not created. The expert item development 
team (n = 8) which included pediatricians, psychometri- 
cians, epidemiologists, pediatric psychologists as well as 
survey development experts, felt in their experience 
most researchers would not want a proxy-report item 
set that was different from the child self-report. The 
team recognized that this was a decision based on 
empirical experience and has not been documented in 
the published literature. 

One of the initial components of the PROMIS child- 
report item bank development process was soliciting 
input on the potential PROMIS items through focus 
groups with children and caregivers [22]. In addition, 
the PROMIS child self-report items all underwent 
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extensive cognitive interviewing with children [23]. 
Hence, it was not anticipated that major item revisions 
would be needed for the adaption of the child self- 
report items to a proxy-report format. One of the key 
issues that the proxy cognitive interviews addressed was 
the understandability and confidence of proxy report on 
the various PROMIS domains. 

A total of 185 items were sampled from the initial 
PROMIS pediatric item banks (n = 293 items) and 
underwent cognitive interviews. These items represented 
all content areas within the domains and were chosen 
by the expert item development team based on which 
items thought most likely to exhibit issues with proxy 
reporting. The primary purpose of the proxy cognitive 
interviews was to derive qualitative information on 
whether there were major issues with the converted 
proxy-report items and to provide insight into which 
items or domains proxy respondents felt most comforta- 
ble answering. A complete list of proxy-report items is 
available elsewhere [24]. 

Proxy cognitive interviews 
Recruitment and participants 

To participate in the proxy cognitive interviews, partici- 
pants needed to be the primary caregiver (parent or 
guardian) of a child between the ages of 5 and 17 years 
inclusive, speak and read English, and provide informed 
consent prior to study entry. We also specifically 
recruited caregivers of children with asthma to review 
all asthma-specific items. 

A research assistant (RA) approached caregivers of 
children who appeared to be between the ages of 5 
and 17 years old and who were waiting for their child's 
clinic appointment at the University of North Caroli- 
na's (UNC) general and subspecialty pediatrics clinics. 
In addition, a study recruitment email was sent 
through the general UNC employee and student email 
system to recruit caregivers from a non-clinic popula- 
tion. The RA provided an explanation of the study and 
scheduled an interview appointment was scheduled for 
eligible participants. At the time of the interview, a 
trained RA obtained informed consent and adminis- 
tered the interview. Participants received a $25 gift 
card in return for their time and effort. The study pro- 
tocol was approved by the institutional review board. 
Cognitive interviews were conducted from November 
2007 through January 2008. 

A total of 25 parents were recruited to participate in 
the cognitive interviews. For each item, the cognitive 
interview sample included at least 5 caregivers - 2 care- 
givers of children of non-white ethnic/racial background 
and 3 caregivers of children ages 5-7 years old. These 
categories were not exclusive. For example, a parent of a 
Hispanic girl age 6 would fulfill both the racial/ethnic 



requirement and the age requirement. The first 25 care- 
givers who met these sampling criteria were interviewed. 
Caregivers with children ages 5-7 were purposely over- 
sampled to ensure that the item content was appropriate 
for proxy respondents with children in this age groups. 
Our earlier published work verified that the content was 
suitable for children as young as 8 years old [23]. 
Proxy cognitive interview process 

We applied a sampling scheme that allowed each parti- 
cipant to be interviewed for approximately 1 h on 
approximately 30 to 40 items rather than all 185 items. 
By this method, the vast majority of the items in the 
bank were reviewed by at least 5 participants (97%) 
meeting the target demographic characteristics outlined 
above (see Recruitment and Participants Section). Care- 
givers with asthmatic children underwent the cognitive 
interview on the asthma-specific item set while the 
other participants were randomly assigned to receive 
another item set. During the cognitive interviews, parti- 
cipants were asked to provide verbal open-ended feed- 
back on each item regarding response categories, time 
frame, item interpretation and overall impression of 
domain content and coverage. These questions (see 
Proxy Cognitive Interview Questions section) were 
based on prior published work [23] and developed by 
the expert item development team. 
Proxy cognitive interview questions 

Items How would you say this question in your own 
words? How easy or hard was this question to answer? 
(If difficult to answer) How would you change the 
words to make it easier to answer? 

Directions When you answered the question, what time 
frame were you considering? When you answered the 
question, did you think only about the past 7 days or 
did you need to think farther back in time? Or did you 
consider the past couple of days? 

Overall Assessment You may have noticed that many of 
our questions contain the words he/she, him/her or 
himself/herself. As you hear these questions, did you 
find this kind of wording to be awkward? If so, is there 
another way that you would suggest we word these 
questions? In general, how easy or difficult was it to 
answer these questions about your child? Explain. Are 
there things that we forgot to ask about that you think 
are important? Overall thoughts/opinions of the 
questionnaire? 

Prior to the cognitive interview, participants com- 
pleted an item set through paper and pencil administra- 
tion. Caregivers were also asked to complete a 
sociodemographic form to report information regarding 
the child's age, gender, ethnicity, race, and chronic 
health condition(s) as well as the parent/guardian's mar- 
ital status, employment status, and educational level 
(Table 1). 
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Table 1 Proxy Caregiver's Demographics and Clinical 



Characteristics for Cognitive Interviews 





N = 25 




(%) 


Child's Gender-Female 


13 (52) 


Child's Age 




5-7 years 


1 7 (68) 


8-9 years 


3 (12) 


10-12 years 


0(0)5 


13-17 years 


(20) 


Child's Grade Completed in School 




1 st or less 


1 7 (68) 




3 (12) 


6 th -11 ths 


5 (29) 


Child's Race 




Caucasian 


14 (56) 


African American 


10 (40) 


Other-Mixed 


1 (4) 


Child's ffftn/c/fy-Hispanic 


2(8) 


Caregiver's Marital Status 




Divorced/Separated 


6(24) 


Married 


13 (52) 


Never married 


6 (24) 


Caregiver's Education Status 




Advanced degree 


10 (40) 


College 


5 (20) 


Some college/ AA 


5 (20) 


High School 


3 (12) 


Some high school 


2 (8) 


Caregiver's Occupation 




Full-Time Employed 


12 (48) 


Part Time Employed 


7(28) 


Not employed 


6(24) 


Chronic Health Condition in Post 6 Months* 


1 7 (68) 


Asthma 



Child ever diagnosed with asthma and currently 14 (56) 

treated 



^caregivers reported child was diagnosed or treated for a chronic health 
condition within 6 months prior to the interview and these conditions 
included (asthma, migraines, anxiety, ADHD/ADD, and allergies) 

All research assistants performing the cognitive inter- 
views underwent 8 h standardized cognitive interview 
technique training and had extensive experience con- 
ducting cognitive interviews prior to this study. These 
interviewers reviewed each item stem and item response 
with the caregiver and began the interview using stan- 
dardized questions (see Proxy Cognitive Interview Ques- 
tions section) for each item. 
Proxy cognitive interview data analyses 
The cognitive interviews were audiotaped to allow for 
recording of detailed participant responses. After com- 
pleting the initial cognitive interviews for an item, the 



research assistants conducting these interviews utilized 
the audio tapes to transcribe and compile a summary 
statement for each item including the caregiver's quotes 
and comments for each cognitive interview question. 
The expert item development team then reviewed all of 
the summary statements from each respondent for each 
item to determine issues with item comprehension, 
instructions, relevance and other general issues. Cogni- 
tive interview results were discussed for every item and 
a consensus decision was made as to the disposition of 
each item. 

Proxy field-test survey instrument 

Following the expert item development team review of 
all cognitive interview results, the PROMIS proxy items 
were assembled in a survey to be utilized in large-scale 
data collection [24]. The sampling plan for the child 
participants is described in detail elsewhere [4]. The 
caregiver proxy forms contained PROMIS proxy items 
and items from widely used fixed length measures 
including the PedsQL™ 4.0 Generic Core Scales Parent 
Proxy-Report version [17], PedsQL™ Asthma Module 
Parent Proxy-Report version [25], and KIDSCREEN Par- 
ent-Proxy-52 [26-28]. These instruments are scored on 
a 0-100 scale, with higher scores indicating better 
HRQOL [17,25-28]. The PedsQL™ 4.0 Generic Core 
Scales Parent Proxy-Report version yielded scale scores 
for physical functioning, emotional functioning, social 
functioning, school functioning, psychosocial health 
summary score and total summary score; the PedsQL™ 
Asthma Module Parent Proxy-Report version yielded 
scale scores for asthma symptoms, treatment, worry and 
communications; and the KIDSCREEN Parent-Proxy-52 
yielded scale scores for physical well-being, psychologi- 
cal well-being, moods and emotions, self-perception, 
autonomy, parent relations and home life, financial 
resources, social support and peers, school environment, 
and social acceptance and bullying. These measures 
were chosen because they are widely used in assessing 
pediatric quality of life and they were administered in 
our child large-scale survey [4]. For simplicity purposes, 
they will be referred to as legacy items or scales 
throughout this manuscript. 

The 293 proxy-report items from 6 general domains 
(Physical Function, Pain Interference, Fatigue, Emotional 
Distress, Social Peer Relationships and Asthma Impact) 
were administered to 1980 caregivers of children partici- 
pating in the study. Because Physical Function includes 
both upper extremity and mobility item banks, Emo- 
tional Distress includes separate anger, anxiety and 
depressive symptoms item banks, and Fatigue includes 
both fatigue and lack of energy item banks, a total of 10 
content areas were tested. A complete list of final PRO- 
MIS proxy items is published elsewhere [24]. To reduce 
respondent burden, a multi-form design was used in 
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Table 2 Distribution of Items by Proxy Test Administration Form* 



Item Banks (number of 
total items) 


Form 

1* 


Form 

2 * 


Form 

3* 


Form 

4 * 


Form 5 


Form 6 


Form 7 


Form 8 


Form Asthma 


PR0MIS Emotional 
Distress-Anger(n = 10) 


10 

items 






10 

items 


10 items 








4 items* 


PR0MIS Emotional 
Distress- Anxiety(n = 1 8) 


18 

items 


9 

items 




9 

items 


9 items 


9 items 






4 items* 


PROMIS Emotional 
Distress-Depressive 
Symptoms (n = 21) 


21 

items 


11 

items 




10 

items 


10 items 


1 1 items 






4 items* 


PROMIS Fatigue (n = 39) 


14 

items 


20 

items 


15 

items 


19 

items 


6 items 


8 items 


12 items 


13 items 


4 items* 


PROMIS Pain (n = 27) 


13 

items 


14 

items 


14 

items 


13 

items 


6 items 


7 items 


7 items 


7 items 


3 items* 


PROMIS Physical 
Function-Mobility (n = 


13 

items 


17 

items 


19 

items 


15 

items 


6 items 


7 items 


10 items 


9 items 


4 items* 



PROMIS Physical 14 20 24 18 6 items 

Function-Upper items items items items 
Extremity (n = 38) 

PROMIS Social Peer 26 38 48 36 12 items 

Relationships (n = 74) items items items items 

PROMIS Asthma Impact 
(n = 34) 



8 items 12 items 12 items 4 items* 



14 items 24 items 24 items 8 items* 



34 items 



Legacy Items 



PedsQL Generic 



PedsQL Generic 
Core 



PedsQL Generic 
Core 



PedsQL Generic 
Core 



PedsQL Asthma 
Module 28 
items; 



Core Scales 23 
items; KIDSCREEN 
52 items 



Scales 23 items; 
KIDSCREEN 52 
items 



Scales 23 items; 
KIDSCREEN 52 
items 



Scales 23 items; DISABKIDS 
KIDSCREEN 52 Asthma 
items Module 14 

items 



*some items are duplicated between forms 



which the items were divided among nine test forms 
(one for caregivers of children with asthma and eight 
for other caregivers), and each caregiver was adminis- 
tered one of the forms (Table 2). To ensure an adequate 
number of individuals responded to all items, each item 
appeared on three of the forms. This process resulted in 
all items being administered to at least 428 parents. 
Caregiver participants were sequentially assigned to 
complete one of the eight testing forms and caregivers 
of children diagnosed with asthma were specifically 
assigned to the form containing asthma items. 

The caregivers survey also included questions to assess 
sociodemographic items including the child's age, sex, 
race, ethnicity, and education as well as the caregiver's 
marital status, education level, occupational status and 
the medical history of the child. The medical history 
included diagnoses of any new chronic health conditions 
within six months prior to study enrollment, treatment 
for existing chronic health conditions within six months 
prior to study enrollment, lifetime diagnosis of asthma, 
and current asthma treatments. 

This sampling plan was developed for collecting 
responses to the candidate items from the targeted 
PROMIS domains and was designed to accommodate 



multiple objectives: (1) assess the factor structure of the 
domains, including tests of local dependence (LD); (2) 
evaluate items for differential item functioning (DIF); 
and (3) calibrate the items for each domain using item 
response theory (IRT). 
Field-test recruitment and participants 
The survey participants included a diverse group of 
caregiver (parent or guardian) -child dyads (for children 
ages 8-17 years old) as well as caregivers (parents or 
guardians) of children ages 5-7 years old. Children were 
selected to have diversity in gender, age, race/ethnicity 
groups, and health status (e.g., children with a variety of 
common chronic illnesses) in order to have a range of 
representation across the latent traits measured by the 
item banks. 

To be eligible to participate in the large-scale testing 
survey, all participants were required to speak and 
read English and be able to see and interact with a 
computer screen, keyboard, and mouse. Children 
enrolled in the study were between the ages of 8 and 
17 years and along with their parents or guardians 
formed a caregiver-child dyad. These caregiver-child 
dyads (children ages 8-17 years old) will simply be 
referred to as dyads. For children 8-17 years old, both 
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members of the dyad were required to complete the 
survey during the same testing session. Children com- 
pleted the pediatric self-report version of the survey 
and parents or guardians completed the proxy-report 
version of the survey. Parents or guardians (caregivers) 
of children between the ages of 5 and 7 years of age 
were also enrolled and only the caregiver completed 
the proxy report survey. The study sample also 
included dyads for children ages 8-17 years old or 
caregivers of children ages 5-7 years old diagnosed 
with asthma. The asthmatic children were required to 
be diagnosed by a physician prior to study participa- 
tion and currently using asthma medication. 

Participants were recruited in outpatient general 
pediatrics and subspecialty clinics. Potential clinic 
pediatric participants were identified through a variety 
of methods such as a review of pediatric clinic 
appointment rosters or while in the clinic waiting 
rooms according to protocols approved by the institu- 
tional review boards (IRBs) of the University of North 
Carolina (UNC), Duke University Medical Center, Uni- 
versity of Washington Center on Outcomes Research 
in Rehabilitation (UW), children's Memorial Hospital 
(CMH) in Chicago, and The children's Hospital at 
Scott and White (S&W) in Texas. Pediatric patients 
within the appropriate age range who had clinic 
appointments and their caregivers were recruited while 
waiting for their clinic appointments. The UNC, Duke, 
UW, CMH and S&W general pediatric clinics see 
patients with a broad spectrum of health issues (e.g., 
well child visits, acute illnesses, and some chronic ill- 
nesses). The specialty clinics including Pulmonology, 
Allergy, Gastroenterology, Rheumatology, Nephrology, 
Obesity, Rehabilitation, Dermatology, and Endocrinol- 
ogy, primarily saw children with more serious chronic 
illnesses. Children with asthma and their caregivers 
were over sampled during recruitment because 
asthma-specific items were tested. 

Caregivers signed an informed consent document 
and children signed an informed assent document 
that outlined the following: purpose of the study, par- 
ticipation requirements, potential benefits and risks of 
participation, and the measures implemented to pro- 
tect participant privacy. The survey was administered 
on laptop computers in a private location. Children 
completed the survey at the time of recruitment with- 
out assistance. Each member of the dyad or the care- 
giver of children ages 5-7 years was assigned to 
complete one of the test administration forms (Table 
2). Each participant received a $10 gift card in return 
for their time and effort. The study protocols were 
approved by the institutional review boards at each 
institution. Data were collected from May 2008 
through March 2009. 



Field-test data analysis 

Descriptive analyses were conducted to describe the 
demographic and clinical characteristics of the study 
sample. Mean scores for legacy scales were calculated 
per instrument instructions [17,25-28] in order to com- 
pare on a descriptive basis normative sample data for 
legacy instruments and the PROMIS proxy sample 
scores on these legacy instruments. Detailed psycho- 
metric properties of the proxy-report item banks are 
described in another manuscript [24]. 

Results 

Proxy cognitive interviews 

Table 1 shows the general characteristics of the children 
and caregivers (all participants were parents) who parti- 
cipated in the cognitive interviews. The interviews did 
not find any issues around item content or understand- 
ing that would require item revisions. This is not sur- 
prising considering that all the items had previously 
undergone cognitive interviews with children. 

Proxy respondents mentioned issues related to 
response options and wording emphasis for two items 
("It was hard for my child to play with pets because of 
asthma" and "How many days did your child have no 
pain"). One caregiver requested a not applicable' option 
be added to the response options for the asthma item 
and that the word 'no' be emphasized in the pain item. 
Neither of these changes was made because it was 
decided that it was more important to keep the proxy- 
report items and the self-report items similar as most 
researchers do not want different proxy and child-report 
item sets. 

A common theme that emerged from the cognitive 
interviews was that 14 out of 25 parents expressed diffi- 
culty in answering some of the items because they did 
not know enough information to reliably report for their 
child (Table 3). The most common reasons given were 
that the child did not share the information with them 
or that they did not observe the child in enough settings 
to adequately assess the information. This occurred 
across several domains but most predominately for the 
social peer relationship domain. In all cases, the parents 
answered the corresponding item on the paper/pencil 
version of the questionnaire despite expressing their dif- 
ficulty during the cognitive interview portion of the 
study. 

Large-scale proxy testing 

Dyads (n = 1548) and caregivers of 5-7 year olds (n = 
432) were enrolled and the sample characteristics were 
similar between both groups (Table 4). The majority of 
caregivers were female (85%), married (69% for children 
ages 8-17; 71% for children 5-7 years old), Caucasian 
(64%) and had at least a high school education (94%). 
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Table 3 Items Caregivers Reported Feeling Uncomfortable Answering 



Item 


Number of Caregivers Expressing Difficulty 
Answering Item/Number of Caregivers 
Answering Item 


Selected Caregiver Quotes 


Asthma Impact Items 


My child's chest felt tight 
because of asthma. 


2/5 


"...she has never said anything directly to me so I had to guess" 


My child got tired easily 
because of his/her asthma. 


1/5 


" I don't see her at school when she would be running around" 


My child's body felt bad when 
he/she was out of breath. 


1/5 


" I don't know how his body felt, son didn't tell me how his body 
felt." 


Emotional Distress Items 


My child worried about what 
could happen to him/her. 


2/5 


"My child doesn't always share his emotions with me." 


My child got scared really 
easily. 


1/5 


"It is harder to ascertain my child's feelings" 


My child felt alone. 


1/5 


'This was hard to answer because if she didn't tell me I wouldn't 
know." 


My child was worried when 
he/she was away from home. 


2/5 


"It's not so much the wording it's that you're asking me to report 
something that I don't know" 


Being sad made it hard for my 
child to do things with friends. 


1/5 


"I couldn't relate to questions about my child's feelings because I 
have no idea." 


Fatigue Items 


My child was so tired it was 
hard for him/her to pay 
attention. 


1/5 


" I just answered to the best I could. I'm not always there when 
she would need to pay attention like at school" 


Pain Items 


It was hard for my child to 
think when he/she had pain. 


2/5 


"I cannot measure/gage if he can think when he has pain as he 
may not tell me" 


It was hard for my child to 
remember things when he/she 
had pain. 


1/5 


"I don't know what he's thinking when he has pain." 


Social Role Relationship Items 


My child was good at making 
friends. 


2/5 


"The friends piece comes at school and I'm not there" 


It was hard for my child to 
make friends. 


2/5 


"I have no idea about things that occur at school or after- school 
that I can't see. These are questions about things that I haven't 
seen with my own eyes." 


Other kids teased my child. 


1/5 


"I'm not at school to see this" 


Other kids did not want to be 
my child's friend. 


2/5 


'These are things that are internal that I can't see as a parent" 


Other kids bullied my child. 


1/5 


"... if he doesn't talk about it or I don't see it happen... then I don't 
know"" 


My child was good at making 
friends. 


2/5 


"Anything that I'm able to observe is a lot easier to answer (vs. 
questions about how my child feels)." 


My child felt accepted by 
other kids his/her age. 


1/5 


"I don't have a gauge to know how he felt. I have to guess" 


Other kids did not want to be 
my child's friends. 


2/5 


"Some questions were harder due to difficulty knowing how to 
answer on behalf of child's experience " 


My child was able to have fun 
with his/her friends. 


1/5 


"this question was a little harder-l had to think about whether she 
had fun since I'm not always with her" 


My child was able to count on 
his/her friends. 


1/5 


"I had to think again about what she has told me." 


My child treated other kids his/ 
her age with respect. 


1/5 


"This was a little harder to answer- because I'm not around her 
when she's around other kids." 


Other kids did not like my 
child. 


1/5 


"This was harder to answer because I am not around my child at 
school." 
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Table 3 Items Caregivers Reported Feeling Uncomfortable Answering (Continued) 



My child felt nervous when 
he/she was with other kids the 
same age. 


2/5 


"I'm not sure what she is like when she is around other kids." 


Other kids wanted to be with 
my child. 


2/5 


"This is hard to answer because I'm not around her during the 
school day." 


Other kids wanted to be my 
child's friend 


1/5 


"With an older teenager it's a little more difficult to know." 


Other kids were mean to my 
child. 


1/5 


"It depends on whether the child tells the parents or if I observed 
it directly." 


My child teased other kids. 


1/5 


"It was impossible to know about other kids since I wasn't there." 


My child played alone and 
kept to himself/herself. 


1/5 


"I thought of it as "at our house". Because in school, Sunday 
school, etc. I do not have the foggiest idea." 



Approximately 50% had children with a chronic health 
condition diagnosed or treated within 6 months prior to 
the interview which was primarily asthma (23% for chil- 
dren ages 8-17; 26% for children ages 5- 7). 

Table 5 compares the mean KIDSCREEN-52 Parent 
Proxy scale scores for the PROMIS proxy sample and 
the KIDSCREEN normative proxy sample [28]. The two 
sample populations scored similarly on many scales. 
However, the PROMIS proxy sample scored lower on 
the School Environment scale and higher on the Social 
Acceptance and Bullying scale for both males and 
females. In addition, for males the PROMIS sample 
average was lower for Moods and Emotions, and for 
females the PROMIS sample average was higher for Psy- 
chological Well-Being, Parent Relations and Home Life, 
and Social Support & Peers. 

Table 6 compares the PedsQL™ 4.0 Generic Core 
Scales Parent Proxy-Report version 4.0 mean total 
scores in the current PROMIS large-scale survey care- 
giver population to the published normative values [29] 
stratified by gender and age group. In general, the PRO- 
MIS proxy sample had similar scores except for 5-6 year 
olds. Table 7 shows a similar comparison stratified by 
the presence of a chronic disease diagnosis including 
asthma or treatment in the 6 months prior to the sur- 
vey. The PROMIS sample averages for proxy reports for 
healthy children were higher than those for thenorma- 
tive sample for all scales except Emotional Functioning, 
for which scores were lower. For proxy reports for chil- 
dren with chronic disease diagnoses, PROMIS sample 
averages were higher for Social Function, School Func- 
tion, and the Total Score. The PROMIS asthma sample 
scored higher on all four PedsQL Asthma samples than 
the original normative sample with asthma. 

Discussion 

Previously published manuscripts documents the metho- 
dology for the PROMIS pediatric self-report item banks 
[4]. The focus of this manuscript was to describe the 



PROMIS proxy-report item development process and 
large-scale survey that evolved from these earlier efforts. 
We anticipate that PROMIS items will be used widely in 
a variety of research settings and hence it is important 
to document the item development process so that find- 
ings from future research can be placed in the appropri- 
ate context. A complete list of items and the 
psychometric characteristics of the final PROMIS pedia- 
tric proxy-report items has been published elsewhere 
[24]. 

Proxy-report items were selected only from the PRO- 
MIS pediatric self-report items. This decision was based 
on the experience of our expert item development team 
because most researchers do not want a proxy-report 
item set that is different from the child self-report. In 
addition, all of the child-report items had undergone 
extensive focus groups with parents and children as well 
as cognitive interview testing [22,23]. It was not surpris- 
ing that the cognitive interviews with proxies found no 
need for major item revisions to accommodate the 
adaption of the child self-report items to a proxy-report 
format. Thus, parents were involved in the item devel- 
opment process for the child self-report versions, and 
their input in the current study was not item develop- 
ment per se as much as cognitive debriefing on the 
modified items. 

An interesting theme that did emerge during the cog- 
nitive interviews was that caregivers reported having a 
difficult time answering many of the items. This was 
because they did not know the information about their 
child either because the child did not share the informa- 
tion or the caregiver did not observe the child in 
enough settings to develop a conclusion. While this was 
particularly true for the social peer relationships domain, 
it was noted across most of the domains. This is not 
surprising as it has been documented that information 
provided by proxy respondents does not always correlate 
well with what is reported by the patient 
[8,11,13,14,16,30-32]. This suggests that the agreement 
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Table 4 Caregivers and Child Characteristics for Proxy Large-scale Survey 



N = 1548 dyad for children ages 8-17 years (% N = 432 for caregivers of children 5 7 years old (% 
of complete data) of complete data) 



Caregiver's Gender 






Male 


228 (15) 


66 (15) 


Female 


1313 (85) 


365 (85) 


Missing 


7 


1 


Caregiver's Age 


Mean = 41.1, SD = 7.8 


Mean = 35.7, SD = 7.9 


Caregiver's Marital Status 






Never Married 


122 (8) 


49 (11) 


Married 


1060 (69) 


306 (71) 


Living with partner 


67 (4) 


23 (5) 


Separated or Divorced 


256 (17) 


46 (11) 


Widowed 


23 (2) 


5 (1) 


Missing 


20 


3 


Caregiver's Race 






White 


980 (64) 


271 (64) 


Black or African-American 


337 (22) 


94 (22) 


American Indian/Alaska Native 


22 (1) 


3 (1) 


Asian 


30 (2) 


10(2) 


Native Hawaiian/Pacific Is. 


5 (.3) 


1 (.2) 


Other 


107 (7) 


34 (8) 


Multiple Races 


{3) 


\Z [5) 


K A i c c i r\ r\ 
IVIIbbll iy 


1 7 
I / 


7 
/ 


Caregiver's Ethnicity 






Non Hispanic 


I 3/u (by) 


jo 1 (by) 


Hispanic 


ID/ [ \ \ ) 


4/ (J \) 


cci nn 
IVIIbbl i iy 


1 1 


4 


Caregivers Relationship to Child 






Mother, Stepmother, Foster 
Mother 


1248 (81) 


352 (82) 


Father, Stepfather, Foster 
Father 


211 (14) 


61 (14) 


Grandparent 


42 (3) 


11 (3) 


Guardian or Other 


35 (2) 


2 (.5) 


Missing 


12 


4 


Caregiver's Education Level 






< = 8 th grade 


27 (2) 


3 (1) 


Some high school 


75 (5) 


23 (5) 


High school degree/GED 


277 (18) 


71 (17) 


Some college/technical degree 


529 (35) 


126 (29) 


College degree 


433 (28) 


123 (29) 


Advanced degree 


193 (13) 


82 (19) 


Missing 


14 


4 


Child's Age (yrs) 


Mean = 12.1, SD = 2.6 


Mean = 6.0, SD = .83 


Child's Gender 






Male 


736 (48) 


189 (44) 


Female 


809 (52) 


243 (56) 


Missing 


3 


0 
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Table 4 Caregivers and Child Characteristics for Proxy Large-scale Survey (Continued) 



Chronic Health Condition in Past 6 
Months 






> = 2 Chronic Health 
Conditions 


791 (51) 


215 (50) 


Most Common Chronic Health 
Conditions* 


174 (11) 


33 (8) 


ADHD/ADD 


91 (6) 


23 (11) 


Arthritis 


84 (5) 


18(5) 


Mental Health Conditions 


54 (4) 


7(2) 


Gl Conditions 


39 (3) 


7(2) 


Diabetes 


24 (2) 


3 (1) 


Allergies 


13 (1) 


9(2) 



*some participants reported more than one chronic health condition 



between child and caregiver report is likely to vary 
across content areas. 

The PROMIS parent proxy-report large-scale survey 
design described above allowed for the evaluation of the 
sample characteristics of the PROMIS pediatric proxy 
item banks. A separate article describes the psycho- 
metric characteristics of the items evaluated in this test- 
ing [24]. The final PROMIS pediatric parent proxy- 



report item banks were developed to provide accurate 
and efficient assessment of important domains of 
HRQOL for children including physical function (mobi- 
lity 23 items; upper extremity 29 items), emotional dis- 
tress (anger 5 items; depressive symptoms 14 items; 
anxiety 15 items), social peer relationships (15 items), 
fatigue (34 items), pain interference (13 items), and 
asthma impact (17 items). 



Table 5 PROMIS Proxy Caregiver Mean KIDSCREEN-52 Scale Scores by Gender 



Kidscreen - 52 Parent Proxy Dimension Scores* Normative Data Sample 




Males 




Females 




N 


Mean (SD) 


N 


Mean (SD) 


Physical Weil-Being 


7351 


51.4 (9.9) 


8322 


48.8 (10.0) 


Psychological Weil-Being 


7375 


50.1 (9.8) 


8380 


49.9 (10.2) 


Moods & Emotions 


7347 


50.4 (10.0) 


8353 


49.7 (10.0) 


Self Perception 


7387 


52.1 (9.8) 


8406 


48.2 (9.8) 


Autonomy 


7426 


50.7 (9.8) 


8448 


49.4 (10.2) 


Parent Relations & Home Life 


7332 


50.1 (9.8) 


8354 


49.9 (10.2) 


Financial Resources 


7282 


49.8 (9.9) 


8291 


50.2 (10.1) 


Social Support & Peers 


7204 


49.7 (10.2) 


8261 


50.2 (10.0) 


School Environment 


7342 


49.1 (10.0) 


8333 


50.8 (9.9) 


Social Acceptance & Bullying 


7421 


49.5 (10.2) 


8427 


50.4 (9.8) 


Kidscreen-52 Parent Proxy Dimension Scores PROMIS Sample 


Physical Well-Being 


207 


51.5 (13.0) 


252 


49.6 (14.3) 


Psychological Weil-Being 


207 


50.9 (10.9) 


248 


52.1 (11.5) a 


Moods & Emotions 


208 


48.1 (13.3) b 


249 


49.5 (11.7) 


Self Perception 


205 


52.1 (11.7) 


248 


48.7 (11.1) 


Autonomy 


208 


50.8 (10.0) 


248 


50.3 (10.7) 


Parent Relations & Home Life 


206 


51.1 (9.8) 


251 


51.7 (11.0) a 


Financial Resources 


205 


50.2 (10.2) 


245 


51.0 (10.9) 


Social Support & Peers 


202 


50.1 (11.2) 


242 


52.4 (11.7) a 


School Environment 


202 


51.0 (11.7) a 


232 


55.0 (11.4) a 


Social Acceptance & Bullying 


209 


45.1 (13.3) b 


246 


46.8 (11.7) b 



*KIDSCREEN proxy is to be administered in caregivers of children ages 8-18 and T scores are reported. 
Normative published data [28] 

a ' indicates PROMIS sample means that are significantly higher (a) or lower (b) (p < 0.05) than the corresponding normative sample means. 
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Table 6 Mean PedsQL™ 4.0 Generic Core Scales Parent Proxy-Report Scores by Gender and Age Group 



PedsQL™Generic Core Scales 




Total Scale ScoreMean (SD) 


Normative Data Sample*-Proxy with Female Child (n = 4834) 




o 1 c ( 1 c r\\ 

ol.b (lo.y) 


Normative Data Sample *-Proxy with Male Child (n = 5236) 




o 1 o ( 1 r r\\ 


PRDMI^ ^nmnlp-PmY\/ with Fpmnlp Chilri (n — l^fs) 
rrSKJIVilj JUiiifJIt riUXy Willi rtlllult L.IIIIU (II — ZDOJ 




89 fs H 1 8^ 
oz.o v I I -O/ 


PR0MIS Sample-Proxy with Male Child (n = 208) 




81.0 (12.1) 


Normative Data Sample *-Proxy with Child Ages 5-7 years old (n = 


2464) 


78.0 (16.4) 


Normative Data Sample *-Proxy with Child Ages 8-12 years old (n 


= 3152) 


78.9 (16.6) 


Normative Data Sample *-Proxy with Child Ages 13-1 years old (n 


= 1384) 


79.5 (16.4) 


PROM IS Sample-Proxy with Child Ages 5-7 years old (n = 106) 




83.3 (10.8) a 


PR0MIS Sample-Proxy with Child Ages 8-12 years old (n = 174) 




81.1 (12.1) 


PR0MIS Sample-Proxy with Child Ages 8-18 years old (n = 187) 




81.9 (12.4) 



*from published normative values [29] 

indicates PROMIS sample means that are significantly higher (p < 0.05) than the corresponding normative sample means. 



The large-scale survey study population included 
caregivers of children with chronic illnesses and 
healthy children. This sampling strategy was designed 
to derive a range of representation across the latent 
traits. Because we envisioned item banks that measure 
across the continuum of the traits of interest (e.g., fati- 
gue, physical function), it was important to include 
caregivers and children with a variety of experiences. 



In addition to allowing for broadly measured con- 
structs, by oversampling children with asthma we were 
able to perform individual analyses within this disease 
population. 

One limitation of this study was that separate analyses 
among specific chronic illness populations (except for 
asthma) was not possible due to small sample sizes for 
each chronic illness. In addition, due to constraints on 



Table 7 Mean PedsQL™ 4 



PedsQL™ 
Generic Scales 


Normative Data 
Sampler-Proxy with 
Healthy Child 


Normative Data 
Sample* -Proxy with 
Chronic Disease Child 


Normative Data 
Sample -Proxy with 
Asthma Child** 


PROMIS 
Sample-Proxy 
with Healthy 
Child 


PROMIS Sample- 
Proxy with Chronic 
Disease Child 


PROMIS 
Sample-Proxy 
with Asthma 
Child 




Mean (SD) 
(n = 8713) 


Mean (SD) (n = 831) 


Mean (SD) (n = 145) 


Mean (SD) 
(n = 289) 


Mean (SD) 
(n = 177) 


Mean (SD) 
(n = 379) 


Physical 
Functioning 


84.1 (19.7) 


77.0 (20.2) 




89.4 (9.8) a 


80.1 (14.3) 




Emotional 
Functioning 


81.2 (16.4) 


71.1 (19.8) 




79.2 (14.7) b 


71.3 (16.8) 




Social 

Functioning 


83.1 (19.7) 


75.1 (20.8) 




89.7 (12.9) a 


79.5 (16.6) a 




School 
Functioning 


78.3 (19.6) 


65.6 (21.8) 




81.3 (15.2) a 


71.2 (16.9) a 




Psychosocial 
Health 


81.2 (15.3) 


71.0 (17.3) 




83.7 (11.7) a 


73.2 (13.5) 




Summary 


Total Score 


82.3 (15.6) 


73.1 (16.5) 




85.8 (10.0) 


75.7 (12.1) a 




PedsQL™ 
Asthma 
Module Scales 


Asthma 
Symptoms 






63.3 (21.4) 






73.3 (20.4) a 


Treatment 
Problems 






77.3 (17.2) 






81.0 (16.2) a 


Worry 






77.4 (22.4) 






84.3 (19.8) 


Communication 






71.4 (26.9) 






77.1 (26.1) 



from published normative values *[29] and **[25] 

a ' b Indicates PROMIS sample means that are significantly higher (a) or lower (b) (p < 0.05) than the corresponding normative sample means 
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sample size not all participants were able to be simulta- 
neously administered both the PROMIS pediatric proxy 
items and the legacy scales. Finally, this study does not 
report on using the items in languages other than Eng- 
lish or in other countries. 

A subset of proxy respondents completed the legacy 
instruments. The PROMIS proxy respondents scored 
worse than the KIDSCREEN Normative sample on the 
Social Acceptance and Bullying scale. This pattern was 
also seen in the PROMIS child-report study [4] and may 
be due to cultural differences between the two popula- 
tions as the PROMIS sample was based in the U.S. and 
the KIDSCREEN sample was European based. This 
would be an area for needed further research. In addi- 
tion, the PROMIS proxy sample, in general, scored simi- 
lar or higher on all legacy measures compared to 
normative samples. 

The ultimate goal of the large-scale survey was to cali- 
brate and obtain item parameters utilizing IRT which is 
independent of the particular sample. Hence, population 
diversity was more important than representativeness. 
This study enrolled caregivers with children who experi- 
enced a wide variety of health states (e.g., children with 
a variety of common chronic illnesses), age ranges, and 
race/ethnicity groups allowing for a diverse sample of 
children to be represented. 

Conclusion 

This manuscript describes the process for developing 
the PROMIS parent proxy-report item banks and the 
sample for establishing item calibrations. Another 
paper describes the psychometric analysis leading to 
the final banks [24]. Further research is indicated on 
construct validity and tests of the responsiveness of 
these scales and item banks in larger samples of care- 
givers of pediatric patients with chronic health 
conditions. 
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